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@ Omnidirectional bar code reader. 



(57) A bar code reader (10) includes an image capture means (26-30) for storing a two dimensional image 
of a bar code symbol (12) in memory (32). The apparatus operates to determine the location and 
orientation (16;18) of the bar code symbol (12) within the field of view of the image captive means 
(26-30), and then filters (20) the located and oriented bar code symbol (12) along an axis perpendicular 
to the detected orientation. Thereafter, the filtered bar code symbol (12) is scanned and applied to a 
decoder (38) to produce a decoded bar code output (44). 
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This invention relates to the field of machine read- 
able symbols, and particularly to a method and 
apparatus for reading of bar code symbols. 

Various machine readable symbols have been 
developed for many applications. For example, the s 
Universal Product Code (UPC) is a barcode symbol- 
ogy widely used in the U.S. retail industry to identify 
products at the point of sale, or for inventory control 
purposes. In the industrial area, other bar code sym- 
bologies have been used for package identification 10 
systems. Common bar code symbologies include 
CODABAR, code 39, interleaved 2 of 5, and code 49. 
In general, machine readable codes provide signific- 
ant advantages in the efficiency of material handling 
and data gathering. is 

A bar code is a particular type of machine read- 
able symbol. A typical bar code includes parallel solid 
lines, or bars, of varying width and spacing. The alter- 
nating light and dark areas defined by the bars and the 
spaces between the bars, represent a digital code 20 
which serves to identify the content of the bar code 
symbol. After being read, the digital code is then 
directly translated to a sequence of alphanumeric 
characters and then by means of a data base, may be 
further translated to the common language descrip- 25 
tion of the item bearing the subject bar code label, 
along with other pertinent data, such as for example 
the current price of the item. 

A bar code may be read by scanning. Typically, 
a small spot of light is directed from a source of til u mi- 30 
nation to the surface of the bar code. The reflected 
light is sensed by a photosensitive element. The small 
illuminated spot of light is then swept across the bar 
code surface, all the while sensing the intensity of the 
resulting reflected light. Since light areas reflect more 35 
light than dark areas, the reflected light intensity rep- 
resents the digital code which serves to identify the 
content of the bar code symbol. 

In one type of bar code reader, a hand held laser 
or LED is used as the source of illumination, and the 40 
reader is manually swept across the barcode surface. 
In a scanning type of bar code reader, the light source 
is stationary while the light beam is moved in a scan- 
ning pattern. A typical scan pattern may be a linear 
bidirectional sweep. In the latter type of scanner, the 45 
bar code symbol and the bar code reader must still be 
manually oriented so that the scan pattern traverses 
all the bars of the bar code in order for the bar code 
to be properly scanned and read. 

I n another type of bar code scanner, a laser beam so 
is swept through a complex series of repetitive 
geometric patterns In order to provide for some deg- 
ree of omnidirectional scanning. All omnidirectional 
laser based scanners tend to be expensive due to the 
initial cost and limited lifetime of the laser light source, 55 
and the associated complex optical elements which 
typically include rapidly rotating polygonal mirrors. 
Also, laser based scanners use an intense concen- 



trated light source which can be an eye hazard, and 
which requires special precautions in manufacturing 
and use. 

Finally, omnidirectional laser scanners tend to 
perform poorly with bar code symbols which have 
been damaged by abrasion, dirt, printing defects, and 
the like. This latter limitation is caused by scan pat- 
terns which are likely to sweep through the bar code 
label only once as it passes under the scanner. If the 
laser sweep cuts through a damaged area of the bar 
code label, a misread (or no read) will occur. 
Additionally, omnidirectional laser scanners do not 
read low aspect ratio bar codes because of the limited 
number of scanning angles in the scan pattern. Also, 
omnidirectional laser scanners cannot read stacked 
bar codes such as code 49. 

In another type of barcode reader, an image of a 
bar code is formed over a one dimensional array of 
photosensitive elements. The one line photosensitive 
array is subsequently serially read out to simulate a 
scan line through the bar code. In yet another type of 
bar code reader, two dimensional image of a bar code 
is formed on a two dimensional array of photosensi- 
tive elements, and subsequently stored in a memory 
for further processing. However, in such prior art bar 
code readers, it has still been necessary to position 
and orient the bar code to the reader. 

In general, in the prior art, it is typically necessary 
for the operator to either orient the bar code, or other- 
wise position the bar code and/or the reader manually 
in order to achieve proper operation. Also, prior art bar 
code readers have difficulty reading damaged labels, 
and stacked or multiple bar codes. The common result 
of these limitations, is misread bar codes or unread 
bar codes, even after repeated attempts. If unable to 
successfully scan the bar code, the data must be read 
and entered manually. In some cases, the bar code 
symbol will pass the scanning station completely 
undetected and unread. In any event, due to the limi- 
tations of the prior art bar code readers, the benefits 
of marking products with machine readable symbols 
is reduced or lost. 

The present invention is embodied in a bar code 
reader in which bar codes are rapidly and reliably 
read. Furthermore, a bar code reader in accordance 
with the present invention provides for high speed 
omnidirectional reading of multiple or stacked bar 
code symbols, or even damaged bar code labels, 
which may be at a random orientation, distance and 
relative motion with respect to the reader. 

The embodiment of the bar code reader in 
accordance with the present invention described 
below includes 1) means for capturing and storing a 
two dimensional image in memory storage, which 
stored image includes a bar code symbol somewhere 
within the field of view, 2) detecting means for proces- 
sing the stored Image for detecting a potential loca- 
tion, or locations, anywhere within the field of view of 
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the stored image, each of which locations being likely 
to contain a bar code symbol, 3) orientation proces- 
sing means for determining the orientation of said 
detected bar code symbol at said detected location 
likely to contain a bar code symbol, 4) filtering means 5 
for filtering said detected bar code symbol in a direc- 
tion perpendicular to said determined orientation of 
said detected bar code symbol in order to utilize the 
redundancy of the bar code symbology, and 5) means 
for scanning through said detected bar code symbol 10 
at a location corresponding to said detected potential 
location and at an angle substantially corresponding 
to said determined orientation of said detected bar 
code symbol. 

It is noted that various combinations of the above 15 
five elements, i.e. Image capture, detection of likely 
bar code location, determination of bar code orien- 
tation, bar code filtering, and barcode scanning, may 
be totally or partially combined into composite oper- 
ations. For example, the detection of likely bar code 20 
locations and the coarse determination of bar code 
orientation may be performed at the same time. Bar 
code fine orientation and filtering may be performed 
in a composite operation as welt. Moreover, bar code 
filtering and bar code scanning may be performed in 25 
a combined processing step. 

It is further noted that although four of the above 
identified elements, i.e. bar code image capture, loca- 
tion, orientation and scan are operations needed for 
omnidirectional bar code reading, bar code filtering is 30 
optional. For example, in some applications it may be 
sufficient to rely on one or more successful scans 
once the bar code symbol is located and properly 
oriented. 

However, it is desirable that the total image pro- 35 
cessing be divided into at least two phases, in which 
the first processing phase permits a large amount of 
image area to be processed in ashort amount of time, 
and in which the second processing phase is rela- 
tively more intensive and more concentrated. During 40 
the first processing phase, some areas of the stored 
image may be identified as likely to contain a barcode 
symbol. In such case, the second processing phase 
operates only on those portions of stored image which 
have been identified as likely to contain a bar code. 45 
Although the second processing phase involves more 
intensive processing, relatively smaller image area is 
needed to be processed during the second proces- 
sing phase due to the selective identification of the 
image areas likely to contain bar codes during the first so 
processing phase. 

The method and apparatus of the present inven- 
tion will be further described with reference to the 
embodiment illustrated in the accompanying draw- 
ings in which: 55 

Figure 1 is a block diagram, partially in flow chart 

form, indicating a method and apparatus in 

accordance with the present invention; 



Figure 2 is a block diagram of a system for a bar 
code reader in accordance with the present 
invention; 

Figure 3 is a graphical representation of a two 
dimensional image area Illustrating individual 
cells used in determining location and orientation 
of a bar code symbol; 

Figure 3A is a representation of a portion of the 
image area of figure 3, which portion contains a 
bar code symbol; 

Figure 4 is a flow chart illustrating the control pro- 
gram for the ASIC controller of figure 2; 
Figures 5A and 5B show a flow chart illustrating 
the control program for the digital signal pro- 
cessor of figure 2; 

Figure 6A is a representation of a bar code sym- 
bol with two typical parallel scan lines, which may 
be utilized in conjunction with the embodiments of 
the present invention ; 

Figure 6B illustrates the reflectance signals from 
the two parallel scan lines of figure 6A; 
Figure 6C represents the signal differences be- 
tween successive data points along each of the 
two respective scan lines of figure 6B; 
Figure 6D illustrates the products of the signal dif- 
ferences for each of the respective data points for 
the signal differences shown in figure 6C, and the 
sum total of all products of the signal differences 
along two parallel scan lines; utilized in conjunc- 
tion with the present invention; 
Figure 7A is a representation of a black to white 
transition with two typical parallel scan lines, 
which may be distinguished from a bar code sym- 
bol in conjunction with the present invention; 
Figure 7B illustrates the reflectance signals from 
the two parallel scan lines of figure 7A; 
Figure 7C represents the signal differences be- 
tween successive data points along each of the 
two respective scan lines of figure 7B; 
Figure 7D illustrates the products of the signal dif- 
ferences for each of the respective data points for 
the signal differences shown in figure 7C, and the 
sum total of all products of the signal differences 
along two parallel scan lines; 
Figure 8A is an image of a bar code symbol at an 
angle to the direction of scan with a portion of the 
scanned area indicated. 
Figure 8B illustrates the reflectance signal from 
one scan line of the scanned area indicated in fig- 
ure 8A. 

Figure 8C illustrates the scan line of figure 8B 

after processing by interpolation. 

Figure 8D shows one interpolated scan line and 

another interpolated scan line, four scan lines 

apart. 

Figure 8E shows eight interpolated scan lines 
which have been shifted respectively into align- 
ment; 
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Figure 8F shows the average of the eight interpo- 
lated and shifted scan lines of figure 8E; 
Figure 8G is a binary signal representation of the 
waveform of figure 8F using the overall signal 
average as the binary threshold value; 
Figure 9A is the cross-correlation function of the 
interpolated first and second scan lines of the por- 
tion of the scanned area in figure 8A; 
Figure 9B is a family of cross-correlation curves, 
each resulting from cross-correlating the first 
interpolated scan line with successive interpo- 
lated scan lines of the portion of the scanned area 
in figure 8A; 

Figure 9C shows the peak values of the cross- 
correlation function for each interpolated scan 
line compared to the first interpolated scan line for 
the portion of the scanned area indicated in figure 
8A; and 

Figure 10 is an illustration of a bar code symbol, 

depicting the manner in which overlapping partial 

scans are concatenated to form a complete scan. 

A brief overview of a bar code reader in accord- 
ance with the present invention is shown in figure i. 
An image acquisition system 14 which includes the 
necessary optical and photosensitive elements, cap- 
tures an image of the reader's field of view, which cap- 
tured image may contain a bar code label 12. 

Once the image is acquired in memory, means 
are provided for bar code image location and coarse 
orientation 16. Together, image acquisition 14 and bar 
code image location and orientation 1 6 comprise the 
portion of the present bar code reader which serves 
to generally locate a bar code within a field of view. 

After the barcode image is located within the field 
of view and its coarse orientation determined, means 
18 are provided for determining the fine orientation of 
the bar code. Having located the bar code and deter- 
mining its fine orientation, means 20 for filtering the 
barcode, are provided. Thereafter, barcode scanning 
22 is performed. The operation of determining the fine 
orientation 18, bar code filtering 20, and bar code 
scanning 22, together comprise the portion of the pre- 
sent bar code reader which serves to "scan" a bar 
code once having been located within a field of view. 
After barcode scanning, a decoder 23 well known to 
those skilled in the art, provides the decoded barcode 
label output 24. 

The operation of "scanning a bar code", as used 
in the prior art, relates to sweeping an illuminated spot 
across a bar code. As used herein, with respect to the 
present invention, the operation of "scanning a bar 
code" means to extract from Image memory storage, 
sequential values derived from said image memory 
storage corresponding to reflectivities along a sweep 
traversing the bar code. 

A preferred hardware embodiment of the present 
invention is shown in figure 2. An optical system 26 is 
coupled to an image sensor array 28. The output of 



the image sensor array 28 is converted from analog 
to digital in A/D converter 30, and stored in a first 
memory 32. The first memory 32 Is preferably a 
dynamic random access memory (DRAM). A control- 

5 ler 34 which may be an application s pecrfic integrated 
circuit (ASIC) controls the image acquisition system 
so as to capture and digitize an image and store ft in 
DRAM 32. The ASIC controller 34 also performs sev- 
eral other processing tasks under the control of a digi- 

10 tal signal processor 38. Digital signal processor 38 is 
typically a high speed microprocessor such as the 
ADSP-2101 available from Analog Devices, Nor- 
wood, Mass. The memory space for digital signal pro- 
cessor 38 is both ROM for program storage, and static 

15 random access memory 42 (SRAM) for image proces- 
sing storage. Portions of the stored image memory in 
DRAM 32 are transferable to SRAM 42 under the con- 
trol of ASIC controller 34. Finally, an input terminal 40 
is coupled to the Input of digital signal processor 38, 

20 and an output terminal 44 is coupled to a decoder 23, 
which is coupled to the output of digital signal pro- 
cessor 38, 

In operation, a bar code read is initiated by an 
input signal on terminal 40 to digital signal processor 

25 38. Responsive to the control outputs of digital signal 
processor 38, ASIC controller 34 acquires an Image 
for storage in DRAM memory 32. Also responsive to 
the control outputs of digital signal processor 38, 
ASIC controller 34 processes the stored Image in 

30 DRAM 32 so as to determine the potential location or 
locations which are likely to contain a bar code sym- 
bol. For location processing, the image stored in 
DRAM 32 is divided into smaller areas, or cells, and 
a location score is assigned to each cell. The higher 

35 the location score for a given cell, the more likely is the 
cell to contain at least a partial bar code symbol. 

When the ASIC controller 34 has completed its 
location scoring task, digital signal processor 38 
examines the resulting scores and commands the 

40 ASIC controller 34 to transfer those image areas of 
interest from DRAM 32 to SRAM 42. Digital signal pro- 
cessor 38 thereafter processes the partial image in 
SRAM 42 to determine the orientation of the stored 
bar code image, to filter the oriented bar code image 

45 along a direction perpendicular to the determined 
orientation, and to scan the oriented and filtered bar 
code image. After all areas of interest have been 
transferred from DRAM 32 to SRAM 42 and proces- 
sed by digital signal processor 38, a complete bar 

so code output scan is provided to decoder 23 which pro- 
vides a decoded bar code label output at terminal 44. 
Alternatively, the function of decoder 23, which may 
have a serial or parallel output, may be included in the 
programming of digital signal processor 38. 

55 On the other hand, if by examination of the loca- 
tion scores, no bar code was found in the stored 
image in DRAM 32, then digital signal processor 38 
through ASIC controller 34 may command the optical 
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system 26, the image sensor array 28 and the A/D 
converter 30 to acquire another image in DRAM 32 for 
processing. The process of acquiring and processing 
images may continue until a bar code symbol is suc- 
cessfully scanned. 5 

The organization of the stored DRAM image area 
48 is shown in figure 3. The image sensor array 28 
(figure 2) has 768 pixels in the horizontal direction and 
576 pixels in the vertical direction. A suitable image 
sensor for use with the present invention is the MOS 10 
image sensor array 98268 available from Hitachi Cor- 
poration. The image area 48 is conceptually divided 
into cells, such as cell 49. Specifically, the image area 
48 is divided into 24 cells in the horizontal direction 
and 72 cells in the vertical direction, with each cell is 
being 8 by 32 pixels. That is, each cell has 8 scan 
lines, with each scan line having 32 pixels. 

The image area 48 is divided into cells in each of 
four directions. That is, image area 48 is divided into 
horizontal cells such as cell 50. However, image area 20 
48 is also divided vertical celts such as cell 52. Simi- 
larly, image area 48 is divided into cells along a rising 
diagonal i.e. 45 degrees such as celt 56. Finally, 
image area 48 is divided into cells along a falling 
diagonal i.e. 135 degrees such as cell 54. Using four 25 
directions of scan lines permits the location process 
to also determine the coarse orientation of the located 
bar code image in the same operation. 

For purposes of illustration, figure 3A shows a bar 
code symbol somewhere within the field of view of 30 
image area 48 and oriented 14 degrees off the vertical 
direction. A typical vertical cell 52 is shown superim- 
posed over a portion of bar code symbol 58. 

The portion of the program of the ASIC controller 
34 (figure 2) for determining the location or locations 35 
likely to contain a bar code symbol is shown in the flow 
chart of figure 4. For a given cell in image area 48, the 
process uses two scan lines, i.e. scan line A, and scan 
line B. Specifically, scan line A is the first of the eight 
scan lines of a given cell, and scan line B is the fifth 40 
scan line of a given cell. After entering the location 
program, the approximate derivative of scan line A, 
and the approximate derivative of scan line B, are cal- 
culated at step 60. For this purpose, a derivative is 
approximated by taking the difference between any 45 
two consecutive pixels. In order to speed up the pro- 
cess of taking an approximate derivative, every other 
pixel is used in the calculation, i.e. instead of using all 
32 pixels across a scan line of a given cell, every other 
pixel i.e. 16 pixels are used to approximate a deriva- so 
tive. 

After finding the approximate derivatives at each 
point of scan line A and scan line B at step 60, the 
point by point product of both derivatives is calculated 
at step 62, Thereafter, the sum of the products of deri- 55 
vatives is accumulated at step 64. This process of 
accumulating the sum of the product of derivatives 
continues until all the points of scan lines A and B are 



completed for this cell at step 66. At this point, the 
accumulated product of derivatives constitutes the 
location score for this particular cell. The location 
score is then stored in SRAM at step 68. The program 
increments to the next cell in the image area at step 
70. The process of computing location scores con- 
tinues from cell to cell until the end of the image area 
is detected at step 72, and the program is exited. 

The process of computing a location score for a 
cell is illustrated in figures 6A through 6D. In figure 6A t 
scan line A and scan line B are shown at a slight angle 
across a portion of a bar code symbol. Figure 6B 
shows the reflectance signals at approximately 1.5 
pixels per narrow bar for both scan line A and scan 
line B. The data points are simply connected by 
straight lines. Figure 6C shows the result of taking the 
difference between successive data points along 
scan line A and successive data points along scan 
line B to produce an approximate derivative shown as 
delta scan line A and delta scan line B, respectively. 
Figure 6D shows the product of each data point along 
delta scan line A and the corresponding data point 
along delta scan fine B. Thus, each score in figure 6D 
for each data point is the product of the approximate 
derivatives of each respective data point of scan line 
A and scan line B. Adding up the sum of the deriva- 
tives produces a location score equal to 810, which is 
a relatively high score because scan line A and scan 
line B are directly through a bar code symbol. 

To illustrate the ability of the location algorithm to 
distinguish bar codes from simple transitions between 
black and white areas, figures 7A through 7D indicate 
the corresponding location score for a simple black to 
white transition. Figure 7A shows an image with a 
black to white transition with two scan lines, scan line 
A and scan line B therethrough. Figure 7B shows the 
reflectance signals for scan line A and scan line B, 
Figure 7C shows the approximate derivative or delta 
scan line A and delta scan line B, white figure 70 
shows the sum of the derivatives for each point on 
both scan line A and scan line B. The resulting loca- 
tion score of 57 from figure 7D for the image in figure 
7A is considerably less than the location score of 810 
for the bar code in figure 6A. 

The program flow chart for the digital signal pro- 
cessor 38 in figure 2, is shown in figures 5A and 5B. 
Responsive to an input signal on terminal 40 of figure 
2, to initiate a bar code read, the digital signal pro- 
cessor 38 enters the program as shown in the flow 
chart of figure 5A. The first step 74, is to command the 
ASIC controller to capture the image area to DRAM. 
Once the image area is captured, the next step 76 is 
to command the ASIC controller to perform the bar 
code location algorithm (in accordance with the flow 
chart of figure 4, discussed above) for one direction 
i.e. the horizontal direction. As the location algorithm 
is performed for all cells in the horizontal direction in 
image area 48, the ASIC controller stores the results 
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in SRAM. Each cell score is an indication of the likeli- 
hood of bar code activity. The complete set of scores 
for a given direction forms a map of the likely regions 
of bar code activity. This process is repeated for all 
four directions i.e. location scores for a vertical scan s 
are computed and stored in SRAM thorough program 
loop 80; location scores for a rising diagonal scan, i.e. 
a 45 degree scan* are computed and stored In SRAM 
thorough program loop 82; and location scores for a 
falling diagonal scan, Le. a 135 degree scan, are com- 10 
puted and stored in SRAM thorough program loop 84. 

Once the cell activity score map for a particular 
direction has been computed and stored in SRAM, the 
digital signal processor program determines whether 
or not bar code activity is present at step 78. For this 15 
purpose, a simple threshold may be utilized, examin- 
ing all location scores that exceed a given threshold. 
If no score exceeds a given threshold, then no bar 
code activity is found, and the program repeats start- 
ing from step 74 in which the ASIC controller captures 20 
a new image area to DRAM. However, if bar code 
activity is detected at step 78, the subsequent digital 
signal processor program, in accordance with the flow 
chart of figure 5B, proceeds to orient, filter, and scan 
the located bar code. 25 

The first step Is to determine from the location 
scores stored in SRAM, the center of the region of bar 
code activity, and the likely horizontal and vertical 
extent of such activity, at step 86. The approximate 
center and extent of bar code activity may be deter- 30 
mined by region growing applied to the cell activity 
score map. Region growing is a common image pro- 
cessing task to identify a particular region of an overall 
image which particular region possesses a specific 
characteristic, in this case, large values. Region grow- 35 
ing is a technique well known to those skilled in the art 
of image processing, and is disclosed in "MATRIX 
STRUCTURED IMAGE PROCESSING* by 
Dougherty and Giardina, published 1987 by Prentice- 
Hall Inc. Englewood Cliffs, New Jersey 07632. 40 

After the region of interest has been determined, 
the digital signal processor commands the ASIC con- 
troller to transfer the image area containing bar code 
activity from DRAM to SRAM at step 88. SRAM mem- 
ory space is generally smaller than DRAM memory 45 
space, and typically represents a few percent of the 
total image area stored in DRAM. Although SRAM is 
generally faster than DRAM, the use of a relatively 
smaller SRAM is more economical since the cost of 
SRAM is typically more than DRAM. Also, the area of 50 
the image stored in SRAM may or may not be related 
to the size of the cell areas from the DRAM image 
memory. Due to the smaller size of the SRAM, the lat- 
ter may hold only a portion of a barcode, in which case 
processing steps are repeated for partial scans and 55 
the partial scans later combined to form a complete 
scan. 

Once the image is transferred to SRAM memory, 



the digital signal processor interpolates each of the 
scan lines of data for a given image area of interest 
at step 90. The process of interpolation is well known 
to those skilled in the art of digital signal processing, 
and is described by Peled and Liu in "DIGITAL SIG- 
NAL PROCESSING theory, design, and implemen- 
tation", published 1976 by John Wiley and Sons. 
Interpolation increases the effective sampling rate of 
the scan line data by fitting the best curve to the data 
with frequencies below the Nyquist limit 

The bar code image is Initially sampled at about 
1 .5 pixels per narrow bar. To create a smoother curve, 
the signal is upsampled by four times. In simple terms, 
rather than connecting the data points by straight 
lines, additional data points are added between the 
actual data points to form a smoother curve. 

After interpolating each of the scan lines at step 
90, the first scan line of a given cell is cross-correlated 
with successive adjacent interpolated scan line data 
as indicated in step 92. Cross-correlation provides a 
measure of the similarity, or match, between two cur- 
ves. Techniques for cross-correlating two signals are 
well known to those skilled in the art, and a discussion 
of cross-correlation may be found in "DIGITAL PRO- 
CESSING OF SPEECH SIGNALS" by Rabiner and 
Schafer published 1978 by Prentiss Halt, Englewood 
Cliffs, NJ 07632. 

Successive cross-correlation between adjacent 
interpolated scan line data provides a means to deter- 
mine the fine orientation of the bar code symbol also 
at step 92. The detected fine orientation of the bar 
code is derived from the difference between the aver- 
age peaks of successive cross-correlations between 
adjacent interpolated scan lines. The position of the 
peak of the cross-correlation function of two scan 
lines represents the amount one scan line of data 
must be shifted in order to provide the best alignment 
with the other scan line of data. Calculation of the 
actual angle of the bars is discussed below in relation 
to figure 9A through figure 9C. 

After the fine orientation of the bar code is known, 
each interpolated scan line data is shifted into align- 
ment at step 94. After the interpolated scan line data 
has been shifted into alignment, the average of all 
scan lines is computed. At this point, the bar code 
symbol may be decoded into a partial bar code scan 
at step 94. 

The partial barcode scan is stored at step 94, and 
the next stored region of interest is determined at step 
96. That is, the next area of interest which is likely to 
contain a bar code image is then transferred from 
DRAM to SRAM at step 88. The process of Interpo- 
lation and cross-correlation is repeated until another 
partial bar code scan, representing an adjacent image 
area of interest, is stored. 

Once all of the stored regions containing barcode 
activity have been scanned, the partial scans are con- 
catenated, or connected to form a complete scan at 
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step 98. Finally, at step 98 the output scan is forwar- 
ded to a decoder, known to those skilled in the art, for 
converting the complete concatenated bar code scan 
into a sequence of alphanumeric characters which 
represent the content of the bar code. 5 

Figures 8A through 8G and figures 9A through 9C 
illustrate the processes for detecting fine orientation, 
filtering and scanning of a bar code that has been 
located in a given cell. Specifically, figure 8A illus- 
trates a vertical cell 52 consisting of 8 scan lines 10 
superimposed over a portion of a bar code label 58. 
The poor appearance, or spottiness of the bars is 
actually representative of the condition of many prin- 
ted bar code labels encountered in practice. 

Figure 8B shows the 32 pixels of the first scan line 15 
of cell 52 connected by straight lines. Figure 8C 
shows the same 32 data points after interpolation, or 
upsampling by four times. Figure 8D shows one 
upsampled scan line, and another upsampled scan 
line which is 4 scan lines away. It Is evident there is 20 
an offset between the two waveforms. This offset is 
indicative of the orientation offset of the bars. 

Although the offset is visibly apparent in figure 
8D, it is necessary to compute the magnitude of the 
offset, i.e. the actual orientation angle of the bars. The 25 
cross correlation function is well suited for this task. 

Figures 9A through 9C illustrate the process of 
determining the fine orientation of the bar code sym- 
bol. Figure 9A shows the cross-correlation function of 
the first and second scan lines of the sampled signal, 30 
Note that the peak is at a lag of about minus one. This 
means that over a distance from one scan line to the 
next, the waveform is shifted one upsampled pixel, or 
one fourth of an original pixel. This yields a bar code 
slope of one fourth, or 0.25, which corresponds well 35 
with the measured slope of about 14 degrees, since 
the arctangent of 0.25 equals 14.036 degrees. 

Figure 9B shows a family of cross-correlation cur- 
ves. Each curve is the result of cross-correlating the 
first scan line with the scan line successively further 40 
away. Note that the peaks step over extremely con- 
sistently by oneforeach curve. By using interpolation, 
it is possible to find the position of a peak in the cross- 
correlation function to fractional pixel accuracy. Fig- 
ure 9C is a plot of the cross-correlation function for 45 
each scan line compared to the first scan line of the 
given area of interest Note that the calculated peak 
values lie almost perfectly along a straight line, the 
slope of which represents the fine orientation angle of 
the bar code symbol. In general, not all of the peak 50 
values may lie on a straight line, in which case the 
average slope may be taken to represent the fine 
orientation of the bar code symbol. 

Once the fine orientation of the bars is known, 
each of the interpolated scan line data is shifted into 55 
alignment as shown in figure 8E, and the average 
value taken as shown in figure 8F. Taking the average 
of corresponding sample points from the shifted lines 



of interpolated scan line data, provides a simple 
approach to bar code filtering. Averaging effectively 
filters perpendicular to the orientation of the bar code. 
In the alternative, the median value of each data point 
could be used to reduce the effect of occasional mis- 
sing pieces of the bar code label. That is, a white spot 
on a black bar effects the median data value less than 
the average data value. Another approach is to take 
a weighted average based on cross-correlation 
scores to provide better rejection of poorly correlated 
scan line data. In the latter case, those interpolated 
scan lines that correlate well with each other would 
count more heavily in the average, while those inter- 
polated scan lines which cross-correlate poorly would 
weight the average correspondingly less. 

As used herein, "shifting" scan line data includes 
both actual shifting of scan line data within the image 
memory as well as virtual shifting of scan line data by 
the use of an offset vector to be added to the location 
of sequential values extracted from said memory. 

It is further noted that bar code fine orientation 
may be achieved by cross-correlation of selected 
pairs of scan line data alone, without interpolation of 
scan line data if there are sufficient data points, or 
pixels per narrow bar. Otherwise, interpolation is used 
to generate the additional data points for the cross- 
correlation to be meaningful. Finally, in shifting scan 
lines into alignment, all successive scan line data may 
be correlated to a single reference line, or in the alter- 
native, successive scan line data may be correlated 
in line pairs and not referenced to a single scan line. 

The aggregate waveform in figure 8F is then con- 
verted to a binary value waveform as shown in figure 
8G using the overall signal average as the binary 
threshold. The zero level of the waveform in figure 8G 
corresponds to the black level of the bar code in figure 
8A, while the one level corresponds to the white level. 

Thus, a partial scan of the bar code shown in fig- 
ure 8A corresponding to the cell 52 has been perfor- 
med. Figure 10 shows how successive partial scans 
100, 102 and 104 may be concatenated to form a 
complete scan of bar code 58. The partial scans over- 
lap each other so that no bar code data is lost. The 
successive partial scans are taken in steps along an 
angle corresponding to the measured fine orientation 
of the bars. That is, since the fine orientation of the 
bars is 14 degrees, a staircase of partial scans along 
a 14 degree angle off the vertical, is constructed In 
order to acquire partial scans which can be concate- 
nated into a complete scan of the bar code label. 

Thus, a bar code reader has been disclosed 
which is capable of reading a bar code symbol con- 
tained anywhere within the field of view of an image 
area in an omnidirectional manner. Although the 
embodiment disclosed suggests the use of an area 
image capture device, it will be appreciated that a 
linear image capture device as may be used with a 
moving conveyor belt, may also be used. 
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Claims 

1. A method for reading a bar code symbol, said 
method comprising: 

capturing a two dimensional image for s 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 
anywhere within the field of view of said stored 
two dimensional image; 

locating an area within the field of view of 10 
said stored two dimensional image, said located 
area being likely to contain a bar code image; 

examining the image within said located 
area to determine the orientation of said located 
bar code image within said located area of said 15 
stored two dimensional image; 

filtering said located bar code image along 
an axis substantially perpendicular to said detec- 
ted orientation of said located bar code image; 
and 20 

scanning said filtered bar code image to 
read out information contained in said located bar 
code image. 

2. A method for reading a bar code symbol, said 25 
method comprising: 

capturing a two dimensional image for 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 
anywhere within the field of view of said stored 30 
two dimensional image; 

locating an area within the field of view of 
said stored two dimensional image, said located 
area being likely to contain a bar code image; 

examining the image within said located 35 
area to determine the orientation of said located 
bar code image within said located area of said 
stored two dimensional image; and 

scanning said located area along an angle 
substantially equal to said determined orientation 40 
of located bar code image to read out information 
contained in said located bar code image. 

3. A method for reading a bar code symbol, said 
method comprising: 45 

capturing a two dimensional image for 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 
anywhere within the field of view of said stored 
two dimensional image; so 

a first image processing phase including 
locating an area within the field of view of said 
stored two dimensional image, wherein said 
located area is more likely to contain a bar code 
image as compared to the other areas of said 55 
stored two dimensional image; and 

a second image processing phase includ- 
ing scanning said located area of said stored two 



dimensional image to read out information con- 
tained in said located bar code image. 

4. A method for reading a bar code symbol, said 
method comprising: 

capturing a two dimensional image for 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 
anywhere within the field of view of said stored 
two dimensional image; and 

scanning said stored two dimensional 
image in an omnidirectional manner in order to 
read out information contained in said stored two 
dimensional image of said bar code symbol. 

5. A method in accordance with claim 4, wherein 
said step of scanning said stored two dimensional 
image in an omnidirectional manner includes: 

locating an area within the field of view of 
said stored two dimensional image, said located 
area being likely to contain a bar code image. 

6. A method in accordance with claim 5, wherein 
said step of scanning said stored two dimensional 
image in an omnidirectional manner further in- 
cludes: 

examining the image within said located 
area to determine the orientation of said located 
bar code image within said located area of said 
stored two dimensional image. 

7. A method in accordance with claim 6, wherein 
said step of scanning said stored two dimensional 
image in an omnidirectional manner further in- 
cludes: 

filtering said located bar code image along 
an axis substantially perpendicular to said detec- 
ted orientation of said located bar code image. 

8. A method in accordance with claim 7, wherein 
said step of scanning said stored two dimensional 
image in an omnidirectional manner further in- 
cludes: 

extracting sequential values from said 
located, oriented, and filtered bar image to read 
out information contained in said located, orien- 
ted, and filtered bar code image. 

9. An apparatus for reading a bar code symbol, said 
apparatus comprising: 

means for capturing a two dimensional 
image for storage in a memory, said stored two 
dimensional image containing an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional image; 

means for locating an area within the field 
of view of said stored two dimensional image, 
said located area being likely to contain a bar 



9 



15 



EP0 449 634 A2 



16 



code image; 

means for examining the image within said 
located area to determine the orientation of said 
located bar code image within said located area 
of said stored two dimensional image; 5 

means for filtering said located bar code 
image along an axis substantially perpendicular 
to said detected orientation of said located bar 
code image; and 

means for scanning said filtered bar code 10 
image to read out information contained in said 
located bar code image. 

10. An apparatus for reading a barcode symbol, said 
apparatus comprising: is 

means for capturing a two dimensional 
image for storage in a memory, said stored two 
dimensional image containing an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional image; 20 

means for locating an area within the field 
of view of said stored two dimensional image, 
said located area being likely to contain a bar 
code image; 

means for examining the image within said 25 
located area to determine the orientation of said 
located bar code image within said located area 
of said stored two dimensional image; and 

means for scanning said located area 
along an angle substantially equal to said deter- 30 
mined orientation of located bar code image to 
read out information contained in said located bar 
code image. 

1 1. An apparatus for reading a bar code symbol, said 35 
apparatus comprising: 

means for capturing a two dimensional 
image for storage in a memory, said stored two 
dimensional image containing an image of a bar 
code symbol anywhere within the field of view of 40 
said stored two dimensional image; 

first phase image processing means 
including means for locating an area within the 
field of view of said stored two dimensional 
image, wherein said located area is more likely to 45 
contain a bar code image as compared to the 
other areas of said stored two dimensional image; 
and 

second phase image processing means 
including including means for scanning said so 
located area of said stored two dimensional 
image to read out information contained in said 
located bar code image. 

12. An apparatus for reading a barcode symbol, said 55 
apparatus comprising: 

means for capturing a two dimensional 
image for storage in a memory, said stored two 



dimensional image containing an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional image; and 

meansforscanning said stored two dimen- 
sional image in an omnidirectional manner in 
order to read out information contained in said 
stored two dimensional image of said bar code 
symbol. 

13. An apparatus in accordance with claim 12, whe- 
rein said means for scanning said stored two 
dimensional image in an omnidirectional manner 
includes: 

means for locating an area within the field 
of view of said stored two dimensional image, 
said located area being likely to contain a bar 
code image. 

14. A method in accordance with claim 13, wherein 
said means for scanning said stored two dimen- 
sional image in an omnidirectional manner further 
includes: 

means for examining the image within said 
located area to determine the orientation of said 
located bar code image within said located area 
of said stored two dimensional image. 

15. An apparatus in accordance with claim 14, whe- 
rein said means for scanning said stored two 
dimensional image in an omnidirectional manner 
further includes: 

means for filtering said located bar code 
image along an axis substantially perpendicular 
to said detected orientation of said located bar 
code image. 

16. An apparatus in accordance with claim 15, whe- 
rein said means for scanning said stored two 
dimensional image in an omnidirectional manner 
further includes: 

means for extracting sequential values 
from said located, oriented, and filtered bar code 
image to read out information contained in said 
located, oriented and filtered bar code image. 

17. A method for reading a bar code symbol, said 
method comprising: 

capturing a two dimensional image for 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 
anywhere within the field of view of said stored 
two dimensional image; 

locating and coarsely orienting an area 
within the field of view of said stored two dimen- 
sional image, said located and coarsely oriented 
area being likely to contain a barcode image; and 

examining the image within said located 
and coarsely oriented area to determine the fine 
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orientation of said located bar code image within 
said located and coarsely oriented area of said 
stored two dimensional image. 

18. A method for reading a bar code symbol in 5 
accordance with claim 17, further comprising: 

filtering said fine oriented and located bar 
code image along an axis substantially perpen- 
dicular to said detected fine orientation of said 
located bar code image. 10 

19. A method for reading a bar code symbol in 
accordance with claim 17, further comprising: 

scanning said fine oriented and located 
bar code image along an angle substantially 15 
equal to said determined fine orientation of 
located bar code image to read out information 
contained in said located bar code image. 

20. A method for reading a bar code symbol, said 20 
method comprising: 

capturing a two dimensional image for 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 
anywhere within the field of view of said stored 25 
two dimensional image; and 

locating and orienting an area within the 
field of view of said stored two dimensional 
image, said located and oriented area being likely 
to contain a bar code image; 30 

21. A method for reading a bar code symbol in 
accordance with claim 20, further comprising: 

filtering said located and oriented barcode 
image along an axis substantially perpendicular 35 
to said detected orientation of said located bar 
code image. 

22. A method for reading a bar code symbol in 
accordance with claim 20, further comprising: 40 

scanning said located and oriented area 
along an angle substantially equal to said deter- 
mined orientation of located bar code image to 
read out information contained in said located bar 
code image. 45 

23. An apparatus for reading a bar code symbol, said 
apparatus comprising: 

means for capturing a two dimensional 
image for storage in a memory, said stored two so 
dimensional image containing an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional image; 

means for locating and coarsely orienting 
an area within the field of view of said stored two 55 
dimensional image, said located and coarsely 
oriented area being likely to contain a bar code 
image; and 



means for examining the image within said 
located and coarsely oriented area to determine 
the fine orientation of said located barcode image 
within said located and coarsely oriented area of 
said stored two dimensional image. 

24. An apparatus for reading a bar code symbol in 
accordance with claim 23, further comprising: 

means for filtering said fine oriented and 
located bar code image along an axis substan- 
tially perpendicular to said detected fine orien- 
tation of said located bar code image. 

25. An apparatus for reading a bar code symbol in 
accordance with claim 23, further comprising: 

means for scanning said fine oriented and 
located bar code image along an angle substan- 
tially equal to said determined fine orientation of 
located bar code image to read out information 
contained in said located bar code image. 

26. An apparatus for reading a bar code symbol, said 
apparatus comprising: 

means for capturing a two dimensional 
image for storage in a memory, said stored two 
dimensional image containing an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional image; and 

means for locating and orienting an area 
within the field of view of said stored two dimen- 
sional image, said located and oriented area 
being likely to contain a bar code image. 

27. An apparatus for reading a bar code symbol in 
accordance with claim 26, further comprising: 

means for filtering said located and orien- 
ted bar code image along an axis substantially 
perpendicular to said detected orientation of said 
located bar code image. 

28. An apparatus for reading a bar code symbol in 
accordance with claim 26, further comprising: 

means for scanning said located and 
oriented area along an angle substantially equal 
to said determined orientation of located barcode 
image to read out information contained in said 
located bar code image. 
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